Acquiring Knowledge from Pre-Trained Model to Neural Machine Translation
نویسندگان
چکیده
منابع مشابه
Pre-Translation for Neural Machine Translation
Recently, the development of neural machine translation (NMT) has significantly improved the translation quality of automatic machine translation. While most sentences are more accurate and fluent than translations by statistical machine translation (SMT)-based systems, in some cases, the NMT system produces translations that have a completely different meaning. This is especially the case when...
متن کاملKnowledge Extraction From Trained Neural Networks
Received Jul 16 th , 2012 Revised Aug 01 th , 2012 Accepted Sept 02 th , 2012 Artificial neural networks (ANN) are very efficient in solving various kinds of problems But Lack of explanation capability (Black box nature of Neural Networks) is one of the most important reasons why artificial neural networks do not get necessary interest in some parts of industry. In this work artificial neural n...
متن کاملKnowledge Extraction from Trained Neural Networks
The artificial neural networks (ANNs) are well suitable to solve a variety class of problems in a knowledge discovery field (e.g., in natural language processing) because the trained networks are more accurate at classifying the examples that represent a problem domain. However, the neural networks that consist of large number of weighted connections (called also links) and activation units oft...
متن کاملFGP: A Virtual Machine for Acquiring Knowledge from Cases
Large case databases are numerous and packed with information. The largest of them are potentially rich sources of domain knowledge. The FGP machine is a software architecture that can make this knowledge explicit and bring it to bear on classification and prediction problems. The architecture provides much of the functionality of traditional expert systems without requiring the system builder ...
متن کاملTemporal Attention Model for Neural Machine Translation
Attention-based Neural Machine Translation (NMT) models suffer from attention deficiency issues as has been observed in recent research. We propose a novel mechanism to address some of these limitations and improve the NMT attention. Specifically, our approach memorizes the alignments temporally (within each sentence) and modulates the attention with the accumulated temporal memory, as the deco...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Proceedings of the AAAI Conference on Artificial Intelligence
سال: 2020
ISSN: 2374-3468,2159-5399
DOI: 10.1609/aaai.v34i05.6465